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Abstract 

This paper considers the optimal portfolio selection problem in a dynamic multi-period 
stochastic framework with regime switching. The risk preferences are of exponential (CARA) 
type with an absolute coefficient of risk aversion which changes with the regime. The market 
model is incomplete and there are two risky assets: one tradable and one non-tradable. In this 
context, the optimal investment strategies are time inconsistent. Consequently, the subgamc 
perfect equilibrium strategies are considered. The utility indifference prices of a contingent 
claim written on the risky assets are computed via an indifference valuation algorithm. By 
running numerical experiments, we examine how these prices vary in response to changes in 
model parameters. 

Keywords: Time consistency, time inconsistent control, incomplete market, utility indiffer- 
ence price. 



1 Introduction 

One of the most important problems in mathematical finance is the valuation of contingent claims 
in incomplete financial markets. 

This paper studies the indifference valuation of contingent claims in a multi-period stochastic 
model under regime switching. The risk preferences are of exponential type and they are allowed 
to change with the regime. 

*Work supported by NSERC grant 371653-09, MITACS grant 5-26761 and the NSFC grant 10901086. 



The problem of pricing contingent claims by utility indifference in an incomplete binomial 
model was studied in [7] and [8] . The work of [7j constructs a probabilistic iterative algorithm to 
obtain utility indifference prices of contingent claims. This algorithm at each step consists of a 
nonlinear pricing functional which is applied to prices obtained at the earlier steps. This functional 
is represented in terms of risk aversion and a special martingale measure. In [8], a more general 
model is considered, with an stochastic factor which may affect the transition probabilities and 
the contingent claim's payoff. Two pricing algorithms are proposed in this paper to produce 
the utility indifference prices. They employ two martingale measures: the minimal martingale 
measure and the minimal entropy measure. This paper also analyses the dependence of the utility 
indifference prices on the choice of the trading horizon. 

Our paper proposes a model with regime switching. Recently, many papers considered the 
pricing of contingent claims on regime switching market. Here we recall only two such works, 
[6] and [5]. In [6], the author considers a stock price model which allows for the drift and the 
volatility coefficients to switch according to two-states. This market is incomplete, but it is 
completed with new securities. In [5] the problem of option pricing is considered in a model 
where the risky underlying assets are driven by Markov-modulated Geometric Brownian motions. 
A regime switching Esscher transform is used to find a martingale pricing measure. 

The novelty our model brings is the change in risk preference during the investemnt horizon. 
The issue of loss aversion changing with time was addressed in financial economic literature. For 
instance, [1] considers a model in which the loss aversion depends on prior gains and losses, so it 
may change through time. We choose to model this effect by allowing the risk aversion to change 
between two exponential type utilities according to the two states of the market (bull and bear). 
In a bull market we expect investors to be willing to take more risk and this is modeled by a lower 
coefficient of relative risk aversion as compared with the bear market. 

This type of risk preferences lead to time inconsistent investemnt strategies. That is, an 
investor may have an incentive to deviate from the optimal strategies that he/she computed at 
some past time. To deal with this issue, [2] developed a theory for stochastic control problems 
which are time inconsistent in the sense that they do not admit a Bellman optimality principle. 
Inspired by [3] and [3], the work of [2] introduced the subgame perfect Nash equilibrium strategies 
in a discrete time model. These strategies are optimal to be implemented in the next time interval 
given that they are optimal in the future. In dealing with the problem of time consistency we 
choose the approach proposed by [2]. 

Our paper proposes an indifference valuation algorithm for pricing contingent claims in a 
discrete time incomplete market with regime switching. At each step, the pricing functional 
depends on the risk aversion, a martingale measure (the minimal martingale measure) and a 
process which keeps track of the previous optimal wealth levels. In the special case of non- 
switching preferences our results recover some of the results of [8]. Moreover, in this case we show 
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that the subgame perfect equilibrium strategies coincide with the optimal ones. 

The goal of this paper is to understand the impact a change in risk aversion has on prices of 
contingent claims. We see in times of financial crises (bear markets) big changes in prices and we 
try to explain it by an increase in investor's risk aversion. We run numerical experiments which 
show that an increase of 20% in risk aversion leads to an increase in prices anywhere between 7% 
and 23%. 

The mathematics we use to prove our results relies on a special form of optimality principle 
applied to a sequence of optimization problems (one for each time period). This involves the 
construction of a sequence of one period BSAEs (one for each optimization problem). The terminal 
value of a BSAE was computed in a previous time step. For the special case of non-switching 
preferences, these one period BSAEs couple in one multiperiod BSAE. In the first step we express 
the equilibrium strategies and utility indifference prices in terms of these BSAEs. In a second 
step, due to the special structure of our model, we manage to get formulas which depend only on 
risk aversion, the minimal martingale measure and a special process ( defined through the values 
of optimal wealth process at antecedent time steps). 

By the best of our knowledge this paper is the first work to address the indifference valuation 
in regime switching incomplete market with regime switching preferences. 

The paper is organized as follows: Section 2 presents the model. Section 3 introduces the 
subgame perfect equilibrium strategies and the indifference valuation algorithm. In Section 4 we 
present the numerical experiments. Section 5 concludes. Proofs of the results are delegated to an 
appendix. 

2 The model 

In this paper we consider a multi-period stochastic model of investment. The randomness is 
driven by a two dimensional discrete time random walk and a Markov chain. Let (b 1 ,6 2 ) := 
(b\ , b\ )n=o,i,...,oo) be a two-dimensional binomial random walk on a complete probability space 
($7, J 7 , {J-j n }, P). The random walk is assumed symmetric under P in the sense that 

P(A6* n = ±1) = 1/2, i = l,2. (1) 

Here A is the difference operator, i.e., 

Ab+ := bt , , — bt . 

A discrete time finite state homogeneous Markov chain (MC) J := («/t„) n =o,i,...,oo is defined on 

(O, {J-~t n }, P) and it takes values in the state space S = {0,1}. The n— step transition matrix 
p(n) = (p(n)^ ig defined by 

Pi? ■■=nJt n =j\Jt =i), i, 3 = 0,1 n = 0,l,...,oo, 
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where P^, = 1 when % = j, otherwise = 0. We assume that the distribution of Jo is known, 
and 

P(J = i\^)=P(J = i), i = 0,l. 

The filtration {J-t n } is generated by the random walk (6 1 ,6 2 ) and (MC) J. The two dimensional 
process S = (S 1 , S 2 ) is referred to as the forward process. 

There are two securities available for trading, a riskless bond and a risky stock. The trading 
horizon is [0,T], with T a exogenous finite horizon. We take the bond as numeraire, thus it can 
be assumed to offer zero interest rate. There are N + 1 trading dates: t = 0, h, Nh, with 
{0, h, ...,Nh} a partition of the interval [0, T]. Here h = T/N, and t n = nh, for n = 0, 1, • • • , N. 

The stock price process S 1 := {Sj; t = 0, h . . . , (N — i)h, Nh}, follows the difference equation: 

' ASl = Sl(iJ,lh + al n VhAbl), n = 0,l...,N-l, 

(2) 

k So 1 = s 1 > 0, 

for some adapted drift process u 1 := t = 0, h . . . , {N — l)h, Nh} and volatility process a 1 := 
{a}; t = 0, h . . . , (N - l)h, Nh} which are chosen so that the stock price remains positive. 

In this model we assume the existence of a non-traded asset Sf = {Sf ; t = 0, h . . . , (N — 
l)h,Nh}, which follows the difference equation : 

' ASl = Sl(filh + alVhp(Abl + ^/T^7Abl)), n = 0,l...,7V-l, 

(3) 

, S 2 = s 2 >0, 

for some adapted drift process \i := {[i 2 t ; t = 0, h . . . , (N - l)h, Nh}, volatility process a := 
{of ; t = 0, h . . . , (N — i)h, Nh}, and the correlation coefficient p, with \p\ < 1. 

2.1 Trading strategies 

An investor in this model starts with initial wealth Xq = x G R and trades between the stock 
and the bond, following self-financing strategies. Let at„ £ .Ft n be the wealth invested in stock 
at time t n , n = 0, 1 . . . , N — 1. The wealth process is governed by the self-financing equation 

AXl := a tn (plh + alVhAbl). (4) 

The state space of the (MC) J is S = {0, 1}, and it is assumed to model two states of the economy: 
the good state (bull market), 1 represents the bad state (bear market). The investor's risk 
preference is assumed to change according to the current state of the market 

U{x,j) = -exp(-7(j» 
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where "f(J), j € {0, 1} is the positive coefficient of absolute risk aversion. The performance of 
an investment strategy is measured by the above expected utility criterion applied to the final 
wealth associated with an investment strategy. The maximal expected utility is given by the value 
function 

v tn (x,j)= sup ¥F(-e-^ x r\T tn ). (5) 
aen tn 

Here n = 0,1. . . ,N — 1, Xj, is given by Xf n = x, Jt n = j, and Tlt n denotes the set of 
admissible trading strategies defined by 

U tn := {a n , a n+ i, ■ ■ ■ , «at_i : a k G T tk , such that E P |X^| < oo, k = n, n + 1 . . . N - 1}. (6) 
2.2 A special martingale measure 

Define a probability measures Q on (O, T, {T^}) such that (6 1 , b 2 ) is a two dimensional random 
walk under Q, and the following equalities holds: 



®(Ab l tn = l\T tn ) = ®(Ab l tn = -1| T t J = is—, n = 0, 1, . . . ,N - 1, 

Q(A6? n = ±l\T tn ) = ^ n = 0, 1, . . . ,iV - 1, 

Q(4, = j\Jt =i) = HJt n = j\Jt =i) = P% ] i,j £S, n = 0,l,...,N- 1. 
Here t x n , defined by 

01 ■= 4 (7) 

is the market price of risk (MPR) for the stock. We choose (MPR) l such that the probability 
measure Q is well defined, i.e., 



1 



>e} >o. 



Expectation under probability measure Q will be denoted by E®[-]. Under Q the stock price 
process S 1 is a martingale, thus we can call Q a martingale measure. In fact this martingale 
measure is related to the minimal martingale measure and the minimal entropy measure (see [S] 
) . The following Lemma is a consequence of the fact P and Q place the same probability weights 
on b 2 . 

Lemma 2.1. For every n = 0, 1, ...N — 1, the following identity holds 
The proof is straightforward and hence omitted. 
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3 Indifference valuation algorithms 



We consider a contingent claim written on (S^S 2 ) to be priced in this model. For simplicity it 
is assumed that its payoff is of the form F(S^, and is to be paid at time T, with F being 
a measurable function. Let A > be given. The writer of A shares of the claim with payoff 
F(S?p, <Sfi), faces the following optimization problem at time t Tl E [0,T]; given the initial forward 
process St n = s = (s , s 2 ), the market state Jt n = i and the initial endowment X tn = x, the writer 
of the option seeks an admissible trading strategy a := (ak)k=n,n+i,...,N-i such that 

a = arg sup E p [- exp(- 7 (i)(*r - \F(S^, S$))\X tn = x,J tn = i,S tn = s}. (8) 

aeU tn 

This optimization problem is time inconsistent due to the fact that the risk preference is 
changing according to the (MC) J. Indeed the optimal strategy computed at time to may fail to 
remain optimal at a later time t n , in the sense of (J8j) , if Jj n ^ Jt ■ One way out of this predicament 
is to consider the game theoretical approach introduced by [2]. In order to ease notations, let us 
denote 

E tn [-] :=E p [.\X tn =x,J tn =i,S tn =s], Efj.|S] := E[-\g \f{X u = x, = s, J tn = i}} 

ffi£[.] ■.= E^\X tn =x,J tn =i,S tn =s], E%[-\G] :=E®[.\g\/{X tn =x,S tn =s,J tn =i}}, 
for every Q C T . 

3.1 The game theoretical approach 

Since optimal trading strategies are not defined within our context, we search for subgame perfect 
strategies. This is done by backward induction. First we consider the time period [(N — l)h, Nh] 
(recall that Nh = T). At time (N — l)h the writer of A shares of claim solve the optimization 
problem 

(PI) V$_ 1 (x,i,s)= sup E^_J-exp(- 7 (0(X£-AFOST,^))], (9) 

Q en tjv _ 1 

and this is refer to as problem (PI). In our model sup in (PI) is attained and we denote 



ak_ i: =arg max E[- exp(- 7 (J tjv _ 1 )(X| - XF(S^, Sf.))l ^-i]- 



(10) 



Notice that in this first step we solve a pure optimization problem. On the time period [(N — 
2)h,Nh] one seeks subgame perfect equilibrium strategies as follows. Let the trading strategies a 
be of the form: 



Oik 



at fork = N-l, 



(11) 



a 



ki 



for k = N - 2, 
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for an arbitrary J 7 t N _ 2 ~ adapted control a^_ 2 such that (a^_ 2 , &n-i) e ^-t N _ 2 - The equilibrium 
value function is defined by 

(P2) V$_ 2 (x,i,8):= sup E tjv _ 2 [-exp(- 7 (*)(Xf -AP(^,^))], (12) 

aeII t]V-2 

and this optimization problem is refer to as problem (P2). In our model sup in (P2) is attained 
and we denote by 



(a x N _ 2 ,Z x N ^) :=arg max E[- exp(- 7 (J^_ 2 )(Xf - \F(&, S$))\T tN _ 2 ], (13) 
«en tAr _ 2 

the equilibrium strategy at tN-2- Further we proceed iteratively. On the time period [(N — 
n)h,Nh] one restricts to trading strategies a of the form: 

c$, for k = N - (n - 1), N - (n - 2), ■ ■ ■ , N - 1, 

(14) 

a£ for k = N — n, 

for an arbitrary F tN _ n - adapted control a^_ n such that (a^_ n , a^){ k=N _ n+1> ... >N _xy G n tjv _ n . 
The equilibrium value function is defined by 



(Pn) V^_ n (x,i,s):= sup E tjv _J- exp(- 7 (i)(X? - AP(4, $))]. (15) 

a6lI *iV-n 

The sup in (Pn) is attained and we denote by 

(a^_ n ,c^_ n+1 ,.-- :=arg max E[- exp(-y(J tir _ n )(X$ - XF(S^, S$))\T tN _ n ], (16) 

the equilibrium strategy at t^- n . Having clarified the choice of equilibrium trading strategies, 
one can turn to pricing of the claim. This is done by utility indifference; more precisely we have 
below the following formal definition. 

Definition 3.1. The writer's indifference price at time tjv-n of the claim with payoff XF(S^, S^) 
is the following Markov process 

Pt N -n = G (tN-n, Xt N _ n , J tN _ n , S tN _ n ), 
where the function G x (t^-n, x,i, s) is given by the equation 

V N~ni x + G x {t N _ n ,x,i,s),i,s) = V$_ n (x,i,s). (17) 
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Thus, the indifference price is the extra wealth that makes the option writer indifferent between 
writing and not writing the claim. In order to find the indifference price at time t^-n one, 
according to equation (fT7|) . has to find the equilibrium value function V^_ n (x, i, s). Consequently 
we have to solve the problems (PI), (P2), • • • , (Pre). Let us start with (PI). Here we have the 
following result. 

Theorem 3.1. The equilibrium trading strategy for problem (PI) is given by the following equa- 
tions 



with 



and 



27(^-! yft ~ 6 V i - Ot^VhJ ' 



log 



H x (t N -!,x,i,s) 



Moreover, the indifference price at time fjv-i, Pt N _ 1 * s given by 

Pt N -l = G (*Ar-l,^tjv_i) JtN-l>St N _!), 



where 



G (t N -i,x,i,s) 



7(i) * JV - 1 



o tjv-l L 1 £ JV J 



Proof of this Theorem is done in Appendix A. 



(18) 



(19) 



(20) 
(21) 

□ 



Next we look at the special case when 7(0) = 7(1) = 7, that is, the preference of the investor 
doesn't change with the market state. Here we have the following result. 

Corollary 3.2. The indifference price Pt N _ 1 ^ s increasing in coefficient of risk aversion 7. 

Proof of this Corollary is done in Appendix B. 

□ 

Let us move to problem (P2). Here, the presentation of the results could be omitted and one 
can directly state the results for (Pn). We choose not to do so in order to ease the reading of 
the manuscript. The following result provides the indifference price and the equilibrium trading 
strategy. 
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Theorem 3.3. The equilibrium trading strategy for problem (P2) is given by the following equa- 
tions 



«Ar_ 2 - &N-2 + H X (t N _2,X tN _ 2 ,J tN _ 2 ,St N _ 2 ), 



with 



and 



a°N-2 



log 



H x (t N ^ 2 ,x,i,s) 



^-2 [log El_ 2 [A ^ ie ^MS^ T) ^ (22 



- E9 [logE^ [A, A eATW^MJljf 1 ] 



where A A is (later) defined in (f24"|) . Moreover, the indifference price at time i7v_2j P^, 
given by 



'IS 



G x (tN-2,X tN _ 2 ,J tN _ 2 ,St N _ 2 ), 



with 



G (t N - 2 ,x,i,s) 



7 (i)^-a 



logE^ [A A e^W^^ijrf i 



(23) 



This Theorem is a special case of Theorem [37 



□ 



Let us consider the general case, that is the problem (Pn). Here, we need to introduce the 
following process (A A ) defined by 



A A 

1V t N - k •" 



AT-1 
j=N-k 



tN-k-l 



N-l 



j=N-k 



, fc = l,2,... ,iV-l, 



(24) 



where the equilibrium strategies (a! A W = jv- n+ i...jy_i\ were determined from solving the problems 
(PI), (-P2), . . . , P(n — 1). The following Theorem is the main result of our paper. 



Theorem 3.4. The equilibrium trading strategy for problem (Pn) is given by the equations 

a° N _ n + H x (tN- n , X tN _ n , Jt N _„ , S tN _ n ) , 



a N-n 
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with 



and 



log 



i + e tAT _Vh 



H (t N - n ,x,i,s) 



MJ tN -M N _ n Vh \i-e tN _ n Vh 



^Pog^I^e^^^l^J] (25) 



- E? [logE^ [A, A ^W^i^ 1 i 



where A-t N _ n+1 ^ s defined in (|24p . Moreover, the indifference price at time i/v-n> Pt N _ n is given 
by 



Pt N -n - GX ( t N-n,X tN _ n ,J tN _ n ,S, 



with 



G (t N - n ,x,i,s) 



7(i 



logE? [A* ^(^(S^WS* 



Proof of this Theorem is done in Appendix C. 



(26) 
□ 

□ 



3.2 The case of constant CARA 

Next we look at the special case when 7(0) = 7(1) = 7. In this special case, the equilibrium 
strategies coincide with the optimal ones. Formally, we have the following results. 



Corollary 3.5. Let us define the following value function: 



V*(x,i t s):= sup E tjv _J-exp(- 7 (X|-AF(5^^))]. 



aen 



t N-n 



The sup in |l?7|) is attained and let 



(a x N _ n ,a x N _ n+1 ,--- ,a^_i) = arg max E % _ J- exp(-y(X^ - \F(S±, S£))], (28) 



t N-n 



be the optimal strategy at ijv-n- Then for every n = 0, 1, • • • , N — 1, 



:A _ -A 



Proof of this Corollary is done in Appendix D. 



(27) 



□ 
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The next result provides a simple iterative scheme to compute the indifference price. 



Corollary 3.6. The following recurrence relationship between p* 



and pt 



JV-n + l 



holds: 



: N-n 



7 



1 



'E Q logE[e 7 ^ 



■JV-n + l 




n 



Moreover, the indifference price p\ 



■N — n 



is increasing in 7. 



Proof of this Corollary is done in Appendix E. 



□ 



This result was proved in [8] for a market model in which the randomness is given by a two 
dimensional random walk. 

4 Numerical examples 

In this section we present a numerical example of our multi-period indifference pricing model with 
regime switching. We consider an European call option on the non-traded asset with a strike price 
K = 10. We consider the following numerical values N = 365, T = 1, Sq = 10, Sq = 10, p = 
0.2, /U 2 = 0.1, a 2 = 0.50. The transition matrix is 



In the first step we want to understand the impact a change in risk aversion has on the 
indifference price. Thus, we assume that in a bull market the risk aversion is 7 and in a bear 
market there is an increase of 20% so that the risk aversion is 1.2 x 7. 

Fig 4.1 plots the percentage change in the indifference price with the reference point being the 
indifference price of a model without regime switching (neither for risk aversion nor for market 
coefficients). We consider that the initial state is either bear market or bull market (the two 
situations are labeled on the plot). The model parameters are fi 1 = 0.1, er 1 = 0.2. 

Next we explore the effect the change in stock's mean rate of return has on the indifference 
price. Thus, in a bull market the stock's mean rate of return is a constant /i 1 and in a bear market 
there is a decrease by 0.2 so it is p 1 — 0.2. 

Fig 4.2 plots the percentage change in the indifference price with the reference point being the 
indifference price of a model without regime switching (neither for risk aversion nor for market 
coefficients). We consider that the initial state is either bear market or bull market (the two 
situations are labeled on the plot). The model parameters are 7 = 0.6, a 1 = 0.2. 



p(i) 



0.6 0.4 



0.6 0.4 
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Finally, we want to see the effect the change in stock's volatility has on the indifference price. 
Thus, in a bull market the stock's volatility is a constant a 1 and in a bear market there is a 
increase by 0.2 so it is a 1 + 0.2. 

Fig 4.3 plots the percentage change in the indifference price with the reference point being the 
indifference price of a model without regime switching (neither for risk aversion nor for market 
coefficients). We consider that the initiate state is either bear market or bull market (the two 
situations are labeled on the plot). The model parameters are 7 = 0.6, a 1 = 0.1. 

5 Conclusion 

In this paper, we consider a multi-period stochastic model with regime switching. A Markov chain 
which takes two possible values ( which are thought of as the two states of markets: bull and 
bear) drives the regime switching. This together with a two dimensional random walk generates 
the randomness of the model. In this model there is a riskless asset (bond) and two risky assets 
(a stock and a non-tradable asset). This market model is incomplete, since there are more sources 
of uncertainty than tradable assets. The risky assets have stochastic mean rate of return and 
volatility which can change with the state of the market. The risk preference can also change 
with the state of the market. However in each state, utility is of exponential type with constant 
coefficient of relative risk aversion. Due to the change in risk preference, the optimal investment 
strategies are time inconsistent in this model. Indeed, the optimal investment strategies computed 
at a given time may fail to remain optimal at later times if the risk preferences are changing. In 
order to overcome this predicament the subgame perfect equilibrium strategies are introduced. 
They are computed iteratively by an algorithm. The goal of this paper is to price within this 
model a contingent claim written on both the stock and the non-tradable asset. Since the market 
is incomplete this can not be done by a replicating portfolio argument. Therefore, we have chosen 
the utility indifference approach. Thus, utility indifference prices of this contingent claim are 
computed via a recursive algorithm (the same algorithm that produces the equilibrium strategies). 
By running numerical experiments we wanted to understand what is the percentage change in 
price if some model parameters are changing. For example we found that the utility indifference 
price will increase by a percenatge anywhere in between 7% and 23% if the market was initially in 
a bear (bad) state, so the coefficient of risk aversion 7 increased by 20% (this change is recorded 
for all values of 7 £ [0.1, 1]). 

6 Appendix 

6.1 Backward Finite Difference Equations (BSAE) 

For an arbitrary n = 0, 1, • • • , N let us consider the BSAE of the form 



12 



)h-Vhz tN _ n Ab tN _ n , (29) 



where yt N _ n+1 is given and it is J^t N _ n+1 \J ^t N - n measura ble. Here z = (z 1 , z 2 , z 3 ), and Ab 
(Aft 1 , Aft 2 , Aft 3 ) with 



A6 3 = f 1, if Afe t \A6 t 2 fe = -1, 
tk I -1, ifA6 t \A6 2 =1. 



The following Lemma is a consequence of the Predictable Representation Theorem. 

Lemma 6.1. The BSAE (|29l) has a unique J 7 t N _ n measurable solution (yt N _ n , zt N _ n ). It is given 
by 

z t N - n = -^^[ytN-n+AbtN-JFt^J, (30) 

Vt N -n = E [^JV-n + l + f( t N-n,St N _ 7l ,Jt N _ 7l ,Zt N _ n )h\J : t N _ 7l ]. 

6.2 Appendix A: Proof of Theorem 13.11 

Let (Yf' } ZfN-t) De ^ e ^tjv-i solution of the following BSAE: 



' Y tN-i = Y t N X + /(*JV-1. ^ 1 ) h - ^/hZl^A^N-i: 



{ y//:=AF(Sl,S 2 ) 



(31) 



for some function f(tN-i, •) to be chosen later on. This solution is known to exist according to 
Lemma 16.11 Next we want to construct a process M" of the form 

M£ = - ex P (- 7 (J ijv _ 1 )(X- - >£■*)), n = N — 1, N. (32) 

Moreover it satisfies the suboptimality/optimality principle 

suboptimality E[M" N \J r tN _ 1 ] < M^ N _ x for all a^Vi. ( 33 ) 

optimality £[M^ = for some a*GVr ( 34 ) 
Once this program is accomplished, it is easy to see that 

S^_ 1 = arg max E[- exp^J^J^ - XF(S^, £$))\ T tN ^\- (35) 
«en ijv _ 1 
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Indeed, from ([32]), ([33]) and (JM} it follows that 

E tiV _ 1 [-exp(- 7 (i)(^-yi A ))] < E % _ 1 [-exp(- 7 ( i )(^_ i -yi A _ i ))] (36) 

= E tjV _ 1 [-exp(- 7 (,)(Xf;_ i -Y t ^J)} 

= E ^ 1 [-exp(- 7 (,)(Xf;-y i 1 ; A ))] 

= V^_!(a;,i,5). (37) 

In the light of ([33]) and pi]) 

E fiV _ 1 [exp(- 7 (0[(X^ - I" _J - (F// - y^J] > 1, (38) 

with equality if a = S A vf _ 1 . Moreover by @ and (|3ip it follows that 



E 



tN-l 



Here z x = (Z^_ i |X 4jv _ 1 = x, S' tjv _ 1 = s, J tjv _ 1 = i), and 



-iW(tN-i,s,i,z<*)h . g N _^ at Sj i t (39) 



5Ar_i(,a,s,z, 2; 



l g - 7 (i)°K 1 JV _ 1 ^ t 1 JV _ 1 ^) 

2 

1 -7(0«Kr-i fc ~<-i VH > 



e -7«a(M t 1 JV _ 1 ft +^ 1 JV _ 1 v / HAfei jv _ i ) _ e7 (i)0I 2 -A6 tiv _ 1 



E, 



*AT-1 



tN-l 



with At fc := {A6| fe = 1} and A^ k := {A6* fc = —1}. Direct computations show that the function 
a — > <77v_i(a, s, i, z a ) is convex, so its minimum is given by the first order condition (FOC). From 
the FOC we obtain the following trading strategy 



&N-1 



2 1 (j tN _ 1 )al N i Vh lo& Vi - Bt^Vh 



(40) 



+ 



log 



Me 



7(^t JV _ 1 )v / fe^ t 1 JV A _ 1 Afe tjv _ 1 , s i 



E 



27(^ 1 K JV _ 1 v / ^ 

Next we choose /(i/v-l> •) such that 

-'r( J t N - 1 )f( t N-i,St N _ 1 ,Jt N _ 1 ,z}£_ t )h a j \_i 

e 5 r A r -ll a Ar-i 1 '3tiv_i 1 -'tiv_i ) ^j JV „ 1/ ) — x - 



(41) 



Therefore, by (|38l) and ([39]) . it follows that d^-i is the equilibrium trading strategy, i.e., a^-i = 
Next we want to elaborate more on ([40 p . Notice that by taking conditional expectation on 
([3T]) . one gets 

VhZl^Ab^ = \F(Si,S*) - AE[F(4,5|,)|^ JV _ 1 ]. (42) 
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By plugging this in (|40p it follows that 



E 



ijv-i 



=7 (j)v / ft^ t 1 JV A _ 1 Ab tjv _ 1 | T s 



Consequently after some trivial manipulations, and by Lemma [2. 11 it follows that the equilibrium 
strategy can be expressed as 



& N-1 



log 



+ 



H^H^Vh^ Vl - 0t N ^Vh 

E Q [e 7(^- 1 )AF(Sj.,5«) |jF g V ^_ i 



log 



(43) 



This, combined with the definition of Q imply (|18p . Let us now turn to the indifference price 
p^ 1 . It follows from (|37|) that 



(44) 



Moreover from the definition of the indifference price Pt N _ n ( see (|17p ) it follows that 



A = y i,A _ y i,o 



(45) 



E[AF(5y,S , ^)|J r i Ar _ 1 ] + f(t N -!, S tN _ 1 , J tN _,, Z^ ^h - f(t N _ 1 ,S tN _ 1 , J tN _ 1 , Z^ ^h, 



1,A 



,1,0 



where the second equality comes from (|3ip . To proceed further with the computations we need 
the expression of /(tjv-i, •)• From (|4Tj) we get that 



f(t N ^,s,i,z") = f(t N ^,s,i,z°) + JlogE tN _Ae^ zXAh »-i\T%}], (46) 



and 



f(t N -i, s,i,z°) 



+ 



(47) 



Pluging (0SD and fl37|) into (gSJ) and making use of (02} we obtain ([201) and ([2T]) . 



□ 
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6.3 Appendix B: Proof of Corollary 13.21 



Let us assume that < 71 < 72; the following result 

tjv_i L I ijv J — ijv-i L I *jv J ' 

comes from Holder's inequality. Taking log in both sides we get 

- logE? [eWCMJpf < 1 bgE^ ^7^(^,51),^] 

^ & *jv-i l 72 w-i7 1 *jv j 

Next, take expectation with respect to the measure Q, and the result yields. 

6.4 Appendix C: Proof of Theorem 13.41 

Let Y! 1 '^ be defined by 

ijV-n + l J 



□ 



N-l 



E 



fc=AT-n+l 



3 A7(Jt„_„)F(Si,S?.)| 7r S 



T ,S T )|jrS WW 

1 *]V-n+l V WV-n 



, (48) 



?i, A <7n,Al 



where {a x }k=N-n+i---N-i was determined from the problems (PI), (-P2), . . . , P(n— 1). Let (Y n ' , Z 
be the solution of the following BSAE 



Y tn- n = Y t n N X n+l + f(tN-n, S tN „ n ,J tN _ n ,Z? N X n )h - VhZ^ X _ n Ab tN _ n , 

for some function /(t7v-n.> •) to be specified later. It is easy to see that 

VhZ^ X Ab tN = Y n ' X -E[Y n ' X LF tv }. 

tjV-n z N-n ijV-n + l L *jV-n + l 1 l N-nl 

As in (PI), we construct construct a process M" k of the form 

Ml = - eM-l(Jt N -J(K ~ Y t n k ' X ), k = N-n,N-n + l. 
Moreover it satisfies the suboptimality/optimality principle 



(49) 



(50) 



(51) 



suboptimality E[Mf 



— M? N _ for all a N _ n such that 

A -An 



{ a N-n^k){k=N-n+l,- ,N-1} G ^ 



(52) 



optimality E[M£ ^ |.F tjv _J = itf* _ n for some <3&_ n such that (53) 

(^N-n^k){k=N-n+l,- ,N-l} € II 4jv _ n . 
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Then, we claim that a^-n 1S an equilibrium strategy, i.e., 



(a N _ n+1 ,--- = ar^ 



max 



( a JV-n' A fe){fc = JV-n + l--iV-l}£nt JV _ n 



n-exp(-<y(J tN _ n )(X$-XF(Sb,Sti)\? tir _ n 



Here 



N-l N-l 

x t ■= x t N . n+1 + Yl Ax tt ' x t : = x ? N . n+1 + Yl Ax t ■ 

k=N-n+l k=N—n+l 

Indeed, by applying iterated conditional expectation property and suboptimality/optimality prin- 
ciple we get 



N-l 



-7(i)Xf r 

-e 'iv-n+i . E[ e 



fc=AT-n+l 



/J1 . Srp J 1 ' I 'S 

1 *JV-n + l 




n J J 




*]V-n4 


1 ] < 


[_ e -T»(^ 


_y», J 
-n *JV- 


n = 




_yn,A 

-n ( JV- 


n ^= 




_yn,A 


1 1 = 



N-l 



- e T« x tV„+i . E[ e 



r (0 £ ax« 

fc=JV-n+l 



e A 7W F(^,5|) |jr 5 WW li 

1 W-n + l V *]V-n JJ 

E r _ R -7(i)(**-AF(S*,S?,))i 



Thus, S^r_ n is the desired equilinrium strategy on (iV — n)/i. Recall that 



Et N _Jexp(- 7 (0[(^_ n+1 -X? N _J - (Y^-Y^J] > 1, 



with equality if and only if a^-n = <5^y_ n . By making use of (|50p and doing similar computations 
as in the case of (PI), leads to 



&N-n 



log 



UJt N . n WL„Vh Vi 



1 + 



V7i 



+ 



log 



Vh 



(54) 



: " +i i^_ n+1 v^-„n^ 



tjV- 



From the definitions of Y^"' A n+i (see (|48|) ) and Q, after some trivial manipulations, (|25j) yields. 
Following the same argument as in (PI) one gets f(tN-n, •) to be 
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tjV-Tl + lJJ' 



(55) 



and 



f(t N - n ,s,i,z°) 



+ 



I JV-n 



Furthermore, as in (PI) we get 



A = yn,A 



(56) 



r, 



n,0 

*JV-r 



(57) 



Consequently p^_ n = G x (t N - n ,X tN _ n ,J tN _ n ,S tN _ n ), where 

G x (t N „ n ,x,i,s) = E[Y^ -Yff \F tN _J+ f(t N - n ,x,s,i,z x )h- f(t N - n ,x,s,i,z°)h 



7 ( t ) 



log( 



E t „_Je 7( ^ +1 |^f 



JV-1 



(58) 



E 



*JV-n 



7(0 tjv - 



log- 



•t® E AX *t 



tN-n+l 



E 



*JV-n 



AT-1 

E A < 

fe=JV-n+l 



7(0 tjv - 



— K Q 

7(0 tN - 

— E Q 

7(0 



logE 



tjV- 



7V-1 



-7(0 AX 

k=N-n+l 



5,A 



3 A 7 (i)F(5i 52) 



AT-1 



E tjv „„ 

A 



- 7 (0 AX 

fc=jV-n+l 



T 
J i 



tpf—n+1 



tk 1 



logJH tjv _ n [A tjv _ n+1 e K%_„ +1 . 



,A7(0^(Si-.S|.)|pS 1 
rt N . 

logE^ [A, A e A 7 (0^(4.^)|j-S 1 i 



(59) 



Here, the first equality follows from (|49p and (|55p . The second equality follows from (|50p . The 



AT-1 



third equality follows from Aj ^t being independent of J~t#_ n+1 ; an d from the definition 

fe=JV-n+l 



of 1^* (see (USD). Therefore flU} holds. 



□ 
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6.5 Appendix D: Proof of Corollary 13.51 

We use mathematical induction to prove the corollary. It is obvious that 

a N-l = &N-1' 

The induction hypothesis is that 

a x = 4, k = (N - 1), (N - 2), • • • , (N - n + 1). 
Next, we have to show that 

a X N - n = a X N - n - (60) 
According to Dynamic Programming Principle 

(Pn) Vjy_ n (x,i,s) := sup E tjv _ n [FjV-n+1 (^JV-n+i , Jn-u+i, Sn-u+i)]- (61) 

aen tjv-„ 

From ([2"T]) and induction hypothesis it follows that 

N-l 

E tN _ n [V N . n+1 (X N . n+1 , JjV-n+l, S N -n+l)] = E tiv . n [- e - 7X ^-n + i . e k=N-n+l . ^(S^S*)} 



N-l 



7 X) AX * 



N-l 



- 7 AX ? K 



In the light of this and (f6"Tj) . the identitity ([60]) follows. 



□ 



6.6 Appendix E: Proof of Corollary 13.61 

From problem (PI), we know that 

Efe-^lJ-i • e^T'^lJr^] = e ^-i . (62) 



From the definition of ( with n = 2), equation (I62D . and from the iterated conditioning 

property we get 
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J 

JV-2 



Prom the optimality principle and from the definition of Y™ N 2 if follows that 



1, A 

■yY, 

g l JV-n+l 



Ee *iV-n + l. e ' tjV-n + 2 



ijV-n + lJ 



JV-1 



- 7 £ A< 



(63) 



Prom the definition of Y^™' A n+i , equation (|63p . and from the iterated conditioning property we get 



t N-n+l 



E [e 7y ^-™+i | Jf„ Ft ] , n = 1, 2 • • • N. 

L 1 c JV-n+l V l N— n'' ' 



(64) 



Thus, by conditioning and making use of iterated conditioning property we get 

-yTl, A -, yll- 1, A 



v^n— 1,A 



(65) 



Therefore 



PtN-n 



1 Efe 7 ^- 1 '^ 1 \K sl \l Ft 1 

-E^[log ; \^t N -J 

T E[e 7yt --^|^l„ +1 V^J 

-E Q [log ( E[e 
7 \ 



(y n-l,A _ y »-l,0 v 



^N-n + l \Z"^*JV-»] ) l"^*JV-»] 

iE«[logE[e^-« +1 |^_ n+1 V^-JI^-J- 



Here the first equality comes from ([58]) and ([65]) . The second equality holds due to i^~ n '° £ 
J-j^ ^ 1 \/ J r tN n . The third equality follows from (|57|) . The monotonocity of p£ N in 7 follows 
from Holder's inequality and an induction argument as in the case of Corollary's 13.21 proof. 



□ 
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